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Q ■ Abstract 

u. 

The contradiction between the fact that many empirical networks possess power-law degree distribution 
and the finding that network of heterogeneous degree distribution is difficult to synchronize has formed 
a paradox in the study of network synchronization. Surprisingly, we find that this paradox can be well 

(N , 

solved when proper gradients are introduced to the network links, i.e. heterogeneous degree distribution is 

IT) 

m 
o 
oo 
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suppose the basic principles for constructing efficient gradient networks and propose a specific coupling 



X 



in favor of synchronization in gradient networks. We analyze the general properties of gradient networks 
and explore their functions in enhancing network sychronizability. Based on these understandings, we 



scheme as verification. Comparing to the previous asymmetric coupling schemes, the new scheme not 
only possesses a much stronger synchronizability but also uses few network information. Moreover, under 
the framework of gradient network, the factors which had been employed in former studies in improving 



network synchronizability can be well unified and identified. The validity of our findings is verified by 
analytical estimates on the behavior of eigenvalues as well as directed simulations on coupled nonidentical 
oscillators. Our study therefore suggests that, in addition to the topology advantage, scale-free networks 
also manifest their dynamical advantage given proper gradients are considered. 

PACS numbers: 89.75.-k, 89.20.Hh, 05.10.-a 
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I. INTRODUCTION 



The study of complex networks has attracted a great deal of interest since the discoveries of 
the small-world QJLJ] and scale-free [2] properties in many natural and man-made networks |3, 
0, Q]. While in initial studies the nodes and links of a network are treated as identical, recent 
studies have extended to the heterogeneous networks of scaled nodes |6fl and weighted links [7] 
where many new features and properties are discovered. Meanwhile, in many practical systems 
the scalars, which usually reflect the different characteristics among the nodes, and the weights, 
which usually characterize the information transport capacities on the links, are closely correlated. 
Typical examples include the co-authorship networks |8|], where the scalar can be regarded as 
the number of papers published by one researcher and the weight represents the collaboration 
times between two researchers, and the world-wide airline network (WWAN) [9], where the scalar 
can be the airport capacity and the weight represents the amount of transportation between two 
airports. In both cases the links which connect nodes of larger scalar often assume larger weights. 
However, the latter is different to the former in that in WWAN the transportation is directed and, 
in most cases, the mass flows in two directions are not balanced, i.e., there exists gradient on the 
links. The gradient networks, which are defined as the directed graphs formed by local gradients of 
a scalar field distributed on the nodes, are ubiquitous in nature and play an important role in many 



biological and technical systems lioi 11 111 . For example, it has been shown that the congestion 



tendency of traffic networks can be drastically reduced when gradient is considered ll 



lib. 



It is well known that the collective behavior of complex systems is strongly influenced by their 



under 

lib, 



ing 



coupling structures. One typical example is chaos synchronization in complex networks 



13Q. Compare to the regular networks, the synchronizability of both the small- world and 



scale-free networks (SFN) are drastically enhanced due to the decreased average distance [14]. 



However, as shown by the recent studies lll5l 



the heterogeneous distribution of both the 



node degree and the link weight could suppress the synchronizability. The contradiction between 
the fact that many empirical networks have the property of heterogeneity and the finding that 
synchronizability are suppressed in heterogeneous networks has formed a paradox in the study of 
network synchronization. This paradox has stimulated the searching of optimal network configura- 
tion in SFN. Specifically, for a SFN of given topology and total coupling cost, people want to know 



how to distribute the couplings could efficiently promote the synchronizability fl 1 3L 
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In Ref. [18] the authors proposed to distribute the incoming coupling strengths according to the 
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local information of node degree (hereafter we mark it as M-scheme). It is found that the synchro- 
nizability is solely determined by the average degree, independent of the degree distribution and 
the system size. In particular, under the condition of uniform coupling capacity distribution, SFN 
achieves its maximum synchronizability which is superior to network of homogeneous degree dis- 
tribution. In Ref. Il20n the incoming coupling strengths are proposed to be distributed according 
to the betweenness centrality of links (hereafter we mark it as C-scheme), it is found that synchro- 
nizability reaches its maximum only when the distributions of these two quantities match. In both 
cases, the couplings are directed and in general they are not balanced, i.e., one direction weights 
over another direction. 

As more and more evidences point to the important roles of gradient couplings, an interesting 
question is: which kind of gradient will be more efficient in improving the network synchroniz- 
ability? The answer relies on two parallel investigations: how to set the gradient direction and 
how to distribute the gradient weight. In setting the gradient direction, an intuitive method is to 
let the gradient start from the larger degree node and point to the smaller one HH. But 
analysis of non-diagonalizable networks suggest that this setting can be arbitrary, given no loops 
in the gradient network [21]. In distributing the gradient weight, the answer is even diverse and 
confusing, the proposed methods range from the uniform weight distribution J19I1 (hereafter we 
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marked it as H-scheme) to the distributions based on local information of node degree [18, 
and on global information of link betweenness Il20ll . Therefore the global picture of the function 
of gradient/asymmetric coupling is still not clear and further study is needed. 

In this work, we will investigate the problem of network synchronization from the gradient 
network point of view and give a generic understanding to the functions of gradient/asymmetric 
couplings in improving network synchronizability. Under the framework of gradient network, not 
only the previous results about asymmetric coupling can be well unified, but also the picture of 
how to distribute the gradient direction and weight becomes clear and simple. For example, now 
it is straightforward to figure out the necessary conditions for heterogeneous network to have a 
stronger synchronizability than homogeneous network and, more importantly, to what extend the 
gradient could benefits the network synchronizability. 

The rest of the paper will be organized as follows. In Section II we will introduce the idea 
of gradient network and some of its basic properties. Based on the previous experiences and 
the new understanding of gradient network, In Section III we will suggest the basic criteria for 
constructing optimal networks and propose a new coupling scheme as application. In Section IV 
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we will analysis the properties of the gradient network emerges in the new coupling scheme and, in 
Section V, show its efficiency in improving network synchronizability by the method of eigenvalue 
analysis. In Section VI we will discuss the multiple effects of gradient and show how the optimal 
gradient changes its value according to the network parameters. In Section VII we present the 
simulation results on coupled nonidentical chaotic oscillators. Finally we give the discussion and 
conclusion in Section VIII. 

H. GRADIENT NETWORK 

For any pair of connected nodes, there are actually two directed couplings. When the weights 
in two directions are equal, we say the couplings are symmetric, otherwise, the couplings are 
asymmetric. To highlight the role of asymmetric couplings, a natural way is to separate the mu- 
tual couplings into two parts: the symmetric part and the asymmetric part. While the symmetric 
part reflects the common strength that two nodes affect each other, the asymmetric part represents 
the dominant role that one node put to another node. Extend this kind of separation to the whole 
network we will find that the original asymmetrically coupled network can be separated into two 
subgraphs: one undirected symmetric network and one directed gradient network. Both two sub- 
graphs have the same topology as the original network, but the coupling direction and weight have 
been changed, as schematically shown in Fig. 1. Specially, the gradient network consists of only 
directed links. While synchronization of symmetric network has been well explored in previous 
studies, the separation of gradient network from the asymmetric network could simplify the prob- 
lem and make the analysis easier. Now our attention solely turns to the study of gradient network 
and investigate its effects on network synchronization. 

Please note that the so formed gradient network is different to those conventional ones. Conven- 
tionally gradient network is defined as the collection of directed links pointing to each node from 

o 

whichever of its near neighbors has the highest/lowest scalar [|10(|. For network of N nodes and 
average degree < k >, according to the conventional definition there will be only N directed links 
in the gradient network. While for the mutually coupled network, every link may have a asymmet- 
ric part and will contributes one gradient link. Thus the gradient network generated from coupled 
system actually has totally < k > xN/2 directed links. By noting that the gradients pointing to 
one node may have different weights and the behavior of this node is mainly determined by the 
largest one (a specific parameter will be introduced later to balance the weight distribution), it is 
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Weighted asymmetric network 



Weighted symmetric network 



Weighted gradient network 



FIG. 1 : The schematic diagram shows how to separate an weighted asymmetric network into a weighted 
symmetric network and a weighted gradient network. 

reasonable to reduce the gradient network from < k > x N/ 2 links to N links by only keeping 
the largest gradient pointing to each node. In other words, for gradient network of heterogeneous 
weight distribution, its main feature can be qualitatively captured by the reduced gradient network 
consisting of only the important gradients. With this simplification, the gradient network gen- 
erated from coupled system will consist with those conventional ones, therefore many results in 

nn 

previous studies can be directed used here H 1 QL 1 1 IN . Hereafter we will only analyze the properties 
and functions of this kind of reduced gradient network, while the correctness of this simplification 
will be verified later by eigenvalue analysis and direct simulations. 

To concrete the idea further, we describe in following the conventional way of constructing gra- 
dient network Jioll . Consider complex network G = G(V, E) which has N nodes V = {1, N} 
and L links E = {1, L}. The set of edges E is specified by a adjacency matrix A = {a it j}, 
dij = 1 if % and j are connected, otherwise a^j = 0, while a iti = 0. For a given node i of de- 
gree hi, the set of its neighbors is denoted by V{ — {j G V | a^j = 1}. Consider also a scalar 
field h = {hi, hx} defined on the set of nodes V, therefore each node has a scalar value hi 
associated to it. For node i of degree ki, the gradient is defined as the directed link pointing to i 
from whichever of its ki neighbors has the highest scalar. If the neighbors have the same scalar 
or if the node has the same scalar as all its neighbors, the selection will be random. Gradient 
network is just constructed as the collection of all these directed links. By this method, the gen- 
erated gradient network consists of N nodes and N links. Except the node of the largest scalar 
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hi = max{/i!, /ijv}, which receives gradient from a node of smaller scalar than itself, all other 
nodes only receive gradient from nodes of higher scalar than themselves. Therefore, except the 
2-node loop formed by the largest scalar node / and one of its neighbor node j, all the other links 
formed a tree structure with nodes I and j at the root. It has been shown that, for homogeneous 
network of random scalar distribution, the degree distribution of gradient network follows a power 
law scaling, P(k) ~ fc~ c , with q rs — 1 

Comparing to those conventional gradient networks, the gradient network generated from cou- 
pled system possesses some new features. Firstly, the node scalar usually are not of random dis- 
tribution, it has a close relation to the properties of the node. Secondly, the gradient are weighted. 
Gradient between nodes of larger scalar difference usually assumes a different weight to that of 
smaller scalar difference. Finally, for sparsely connected networks we need to consider the prob- 
lem of network breaking, i.e. the degeneration problem IllOn . All these new features extend the 
conventional concept on gradient network and arise new problems for investigation. Our mission 
is just to characterize this kind of new gradient network and explore its functions in steering the 
collective behavior of coupled networks. 

HI. CONSTRUCTING THE COUPLING MATRIX 

Gradient, also known as bias, has been employed in nonlinear studies for many years and 
proven to be a powerful technique in many fields such as chaos control and chaos synchroniza- 
tion. For example, for coupled oscillators on lattice it has been shown that the increase of gradient 



could greatly enhance t he sy nchronizability of the system |22fl. The asymmetric coupling schemes 



proposed in Refs. Hi 81 . 1191 12011 suggest that gradient can be used to complex networks as well. 



Gradient has been also employed in turbulence control, where the introduction of gradient could 



significantly improve the control efficiency ||23|] . While different study proposes different scheme 
in setting the gradient, these schemes are nonetheless not unified. In particular, for complex net- 
works, people are still not clear of the proper way of gradient configuration, i.e. how to set the 
gradient direction and weight. Now, from the view point of gradient network, these studies can be 
well unified and the principles for constructing optimal network can be vividly portrayed. 

By reviewing the previous studies, we can get some important clues in constructing the matrix. 
(1) Based on the recent findings that 'hubs' are firstly synchronized than 'nonhubs' and the firstly 



synchronized 'hubs' act as the "core" in pattern formation of complex networks Q24 



3,Q],it 



seems 
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plausible to build mutual links between 'hubs' in the first place. In other words, the gradient 
between the hubs, if they are directly connected, should be small. By this setting we wish to build 
an efficient channel between the hubs and to form the synchronous core quickly. (2) To guarantee 
that the synchronous manifold of the "core" can be efficiently propagated to the 'nonhubs' while 



keeping the stability of the 'core' itself [19], it is reasonable to set the gradient start from 'hubs' 
and point to 'nonhubs'. According to this requirement we can set the gradient direction. (3) In 
practical systems the gradients pointing to one node generally have different weight, neighbors of 
higher scalar may generate larger gradient than those of lower scalar. To distinguish this difference, 
it is reasonable to set the gradient weight being proportional to the scalar potential. Setting in this 
way, the behavior of each node will more likely to follow its larger degree neighbors. Therefore, in 
determining the final synchronous state of the whole network, the high degree nodes have a larger 
contribution than the smaller degree nodes. (4) For most practical systems, each node has only 
limited information of the whole network, e.g. the degree information of itself or its neighbors. 
Which means that, in constructing the coupling matrix, the convenient method should employ only 



the local network information jlS 



19] 



Based on the above understandings, we propose a new coupling scheme for network synchro- 
nization. In particular, we consider networks of coupled chaotic oscillators following equations 

N 

x, = F(xf) - eJ2Gi,M^}, i = 1, -N, (1) 

i=i 

where F(xj) governs the local dynamics of uncoupled node i, H[x] is a linear coupling function 
and e is the coupling strength. Gij is a zero rowsum coupling matrix with off diagonal entries 
read 

— j 7/3' ^3 = 1' •••-^j (2) 

with A the adjacency matrix defined in Sec. II, kj denotes the degree of node j, and (3 is a tunable 
parameter which will be used to adjust the gradient weight distribution. The diagonal entries are 
unit G iyi = 1. 

IV. THE PROPERTIES OF GRADIENT NETWORK 

We first investigate the properties of the gradient network formed by Eq. |2[ For a pair of 
connected nodes i and j, denote k L (kj) the degree of node i (j) and Vi (Vj) the set of its neighbors, 
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then the gradient from i to j reads 

k P k 13 1 

AG^j = G jti - Gij = — l — -g - — ^— j = — — [fcf 2J ^ _ z2 ^fL ^ 

with Cjj = X^e^- Si'GVi ^i^v- With the language of gradient network, it is straightforward to 
define the node scalar as follows 

fc = *fZX- ( 4 ) 

This scalar will be used to determine the gradient direction, i.e. from higher scalar to lower scalar; 
while the gradient weight is determined by the scalar potential A/ijj = hi — hj and C^j, which 
depend on the degree situation of the node and its the neighbors. For SFN generated via the BA 
model B2D, there is no degree correlation between the nodes Q2VD , i.e. the chance to find a large 
degree neighbor or a small degree neighbor is the same for any given node. Specifically, we have 
for this kind of network the relation J2iev ^1 ~ ^- Substitute this relation into Eq. @]we have 

hi ~ k] +p . (5) 

It can be found that, for positive value of (3, larger degree node generally possesses a larger value 
of hi and the gradient is started from the larger degree node and point to the smaller degree node, 
while the contrary situation occurs when /3 < 0. (Note that with a slim chance the gradient may 
flow from smaller degree node to larger degree node. This situation happens when a smaller degree 
nodes has very large degree neighbors. However, this chance is very small and, statistically, the 
relation Eq. |5]is still valid, specially for network of dense connections.) Therefore, we can control 
the gradient direction by changing the sign of [3, while control its weight, which is proportional to 
the scalar difference as shown in Eq. [31 by its absolute value \(3\. 

The constructed gradient network consists of iV nodes and < k > xN/2 directed links. To 
simplify the analysis, we assume (3 — » 00 and discuss the reduced gradient network which consists 
of only N links. As we discussed in Sec. II, this reduction will not affect the main results we get 
for gradient network, but will make the analysis much easier. Now we argue that the formed 
gradient network is of forest structure (for obvious reason, we ignore the 2-node loop formed by 
the largest degree node and one of its neighbors) and its out-degree follows a power law degree 
distribution. To prove the forest structure, assume that on the contrary, there is a closed path 
$ = {AG 2 ,i, AG3 2, AG^_i}, / > 3 made up only of directed edges selected from the gradient 
network. Let j be the node on this path for which hj = min{hi, h 2 , h m }. Node j has exactly 
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FIG. 2: (Color online). For network of N = 2 u nodes and mean degree < k >= 6. (a) The out-degree 
distribution of the gradient networks generated on SFN and RN substrates. Both distributions follow power- 
law scaling with q pa —2.8 for SFN substrate and ? « — 1 for RN substrate, (b) The probability of network 
breaking as a function of degree heterogeneity 7. Inset plots the breaking probability as a function of the 
mean degree < k >. It is found that network tends to be broken as 7 increases or < k > decreases. Each 
data is an average result over 100 realizations. 

two neighbors on $, nodes j ± 1, but only one gradient, AG^+j or AGj pointing to j. Since 
hj < hj±i, both of the neighbors j ± 1 will have their gradient edges pointing into j. Since there 
are two edges, (j — 1, j) and (j, j + 1), and only one gradient edge will be accepted by j, one of 
the edges must not be a gradient edge, and thus the loop is not closed, in contradiction with the 
assumption that there is a loop with only gradient edges. 

We go on to estimate the out-degree distribution. For node i which has degree k^ assume node 
/ G Vi is one of its neighbors, then the probability for I to receive gradient from i is determined by 
two elements: the probability of hi > hi and the probability that hi has the largest scalar among 
the neighbors of I, i.e. hi = m&x{hj, j 6 V/}. Due to the zero degree correlation, the chance 
to find a connection between i and / is pi = h/(N — 1); according to Eq. |5l the probability for 
hi > hi equals that of ki > ki (here we discuss only the case of (3 > 0, while the analysis for j3 < 
is the similar), which is p 2 = f, fcl P(k)dk; the probability that hi is the largest scalar among the 
neighbors of / is p 3 == 1 — (hi — l)p' 3 = 1 — (ki — 1) J fc fcmax P(k)dk, where p' 3 represents the 
probability that one link of / connects to some node of larger degree to i. Therefore, the probability 
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for I to contribute an out-degree to i is 



Pi = P1P2P3 = h/(N - 1) • / P(k)dk 

&min 



{hi 



P{k)dk 



(6) 



According to the network growth algorithm [2], we have A; max « m x and A; min — m (m 

is the number of links associated to the new node in the BA growth model). Noting that the 
contribution of out-degree may come from any node of degree smaller than k^ substituting the 
relation P(k) = Ck~^ = (7 — l)m 7-1 A;~ 7 into Eq. [6l we get the probability for each link of % to 
become an out-degree link is f, 1 piNP(l)dl. Finally, the totoal number of out-degree for node i 
is 



k, 



out 



k i 



h - I P iNP(l)dl 

""mm 

C k^ ' I \ kj ' I k ^ dk ' 

"hi 1 — 



hi r phi 

lh- P(k)dk ■ 

m L J m 



l-C{l-\) 



1 - (/ - 1) 



k-^dk 



P{k)dk 



l^dl 



cr^di 

(7) 



Denoting f* k^dk = a and J^ max k~^dk = b, we have 



k out = C% ■ t {h ■ a ■ [1 - C(l - 

J m 



aC 2 ki ■<{! + Cb)a - Cb 



ni 



- k 



2-7 



7-2 



(8) 



For h 5, Lx, Ca ~ 1 and Cb ~ 0, we have 



kout ~ ki 



(9) 



Therefore the out-degree distribution of the gradient network is the same to the degree distribution 
of SFN, which is 

p out ~ P(k) ~ kp. (10) 

The exponent we get from numerical simulation matches this prediction very well, as shown in 
Fig. 2(a) where the fitted exponent is q w —2.8. Following the similar deduction, we can also 
proof that the out-degree distribution of random network also follows a power law distribution, 
but with exponent q = — 1. This relation is verified by numerical simulation again and the result 
is plotted in Fig. 2(a) by another curve. 

Using a similar reasoning as for the forest structure, we can prove that there is no continuous 
path which connects two local maxima of the scalar field h. This means that for each tree of the 
gradient network there is only one local maximum scalar, and it is the only node which forms 
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a 2-node loop with one of its neighbors. As a consequence, the number of trees in the forest 
equals the number of local maxima of the scalar field h. In other world, if there are more than 
one tree appear in the forest, the gradient network will be broken into disconnected small graphs. 
This kind of breaking phenomenon is crucial to network synchronization, since once the network is 
disconnected, it will never be synchronized whatever how large the coupling strength is. Therefore, 
to fully explore the function of gradient, we also need to estimate the breaking risk it may induce. 
Specifically, we want to know which kind of network could bear a larger gradient. In following 
we argue that densely connected heterogeneous networks are more capable of larger gradient than 
sparsely connected homogeneous networks. For SFN of degree heterogeneity 7, the largest node 
has about A; max ps ^^N~ links. Therefore the chance for the two leading nodes to be directly 
linked is about P con ps 2/c max /iV. In other words, the chance for them to be indirectly linked will 
be Pbreak = 1 — Peon- As the forest will broken into at least two trees when the two leading nodes 
are not directly connected, we have the network breaking probability 

P break = 1 - 2fc max /iV « 1- < k > (11) 

This is only an estimation of the breaking probability, since the indirect connection of other rela- 
tively larger degree nodes, instead of the two largest ones, may also break down the forest in some 
cases. Such chance, however, is very small comparing to Pbreak an d can be neglected, especially 
for networks of larger 7. (To construct networks of variable 7, we adopt the model proposed in 
Ref. 112 811 . i.e. set a tunable parameter B to each node and adjust the preferential attachment func- 
tion to be p ~ (ki + B)/ 52 . (kj + B). The scaling exponent 7 is then given by 7 = 3 + B/m, with 
m the number of new links associated to each new node in network growth.) Numerical results 
on the breaking probability as functions of 7 and < k > are plotted in Fig. 2(b). It can be found 
that the predictions fit the numerical results reasonably well, especially in regions of larger 7 and 
smaller < k >. 



V. SYNCHRONIZABILITY ANALYSIS 

We now analyze the function of gradient network to network synchronization. The synchro- 
nizability of coupled networks can be evaluated by the method of master stability function (MSF) 



3011 . if the eigenvalues are reals, or by the method of eigenvalue analysis Il22ll . if the eigen 



values are complex values. These methods tell us that the problem of synchronizability can be 
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divided into two separating issues: the stability of the single dynamics F(x) and the distribution 
of eigenvalues of the coupling matrix G. For most systems, the single dynamics is stable within 
a certain range in the parameter space, o E [cr 1 , a 2 ]. The network is synchronizable iff all the 
eigenvalues except the one Ai = 0, which corresponding to the synchronous manifold, can be 
contained within this range after a linear scaling, i.e. \n/X 2 ^ with A at the largest and A 2 

the smallest positive eigenvalues, respectively. In other words, the quantity of synchronizability 
can be described by the eigenratio R = Ajv/ A2, with a smaller R represents a stronger synchroniz- 
ability. Meanwhile, when network is synchronized, larger A 2 usually means smaller coupling cost 
since e > o\j\%. 



22Q, but for the 



The eigenvalues of asymmetric matrix G are usually complex values IU9L 
coupling matrix G constructed in Eq. [2} they are reals. Noticing that the coupling matrix can 
be written as G = QLD 13 , with D = diag{ki, k 2 , ...k^} the diagonal matrix of degrees and 
Q = diag{l/ Lijkj , ...1/ J2j LNjkj} the normalization factors for rows of G. From the 
following identity 

det(QLD p - XI) = det(Q l ' 2 D^ 2 LD^ 2 Q 1 ' 2 - A/) (12) 

we can find that the eigenvalues of the asymmetric matrix G are the same as that obtained from 
the symmetric matrix H = Q 1 l 2 D li l 2 LD li l 2 Q 1 / 2 , which are real and nonnegative values. 



can be 



From the viewpoint of gradient network, the previous coupling schemes [|18L 
well unified and the role of gradient can be easily identified. In M-scheme the gradient is generated 
according to the degree difference and adjusted via parameter j3 M , i.e. hi = 1/kf and AG^ = 
(kf — hj)/(kfkj). A negative value of (3m represents that the gradient flows from the smaller 
degree node to the larger degree node, while for positive (3 m the gradient flows in the opposite 
direction. As reported In Ref. [18] and repeated in Fig. 3(a), the maximum synchronizability 
happens at (3m ~ 1- Since the gradient increases its weight as (3m increases from 0, it is of certain 
surprise to find that, instead of enhancement, larger gradient will suppress synchronizability when 
(3m > 1. Another intriguing observation is the sharp change of eigenratio R as (3 varies: R m 
2 x 10 3 at (3m = —1 while R rs 6 at (3m = 1- While the optimization at (3m ~ 1 can be 
understood by the heterogeneous distribution of the coupling capacity among the nodes (at (3m = 
1 the coupling capacity is the same for all nodes) and the decreased total coupling cost as (3m 
increases from the optimal value (as (3m increases from 1 the total coupling of the network will be 
decreased), the sharp change of R demonstrates the nontrivial effect of gradient played in network 
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synchronization. In Fig. 3(a) we also plotted the variations of the eigenratio as a function of 
the gradient for C-scheme, where gradient is generated by the betweenness difference between 
the connected nodes, and for H-scheme, where gradient is generated by the aging difference. 
For C-scheme, the gradient weight is adjusted by parameter (3c, with negative values represent 
that the gradient flows from node of smaller betweenness to node of larger betweenness, while 
the opposite happens for positive (3c- Again, the absolute value of (3c represents the weight of 
gradient. The behavior of R is quite similar to that of M-scheme, i.e. optimal configuration exists 
at around (3c ~ 1 while larger gradients suppress synchronizability, except that the variation of 
eigenratio is much slow than that of M-scheme. For H-scheme the gradient weight is adjusted via 
the parameter (3jj, with negative values represent that the gradient flows from the 'older' (larger 
degree) node to the 'younger' (smaller degree) node, while opposite happens for positive (3h- 
Again, the absolute value of (3h represents the weight of gradient. Different to the former two 
schemes, it is found in Fig. 3(a) that for H-scheme the eigenratio R monotonically decreases as (3h 
decreases from 1 to —1, or, similarly, as the gradient from 'older' to 'younger' increases its weight. 
Noticing that (3h = equals the situation (3m = 1 in M-scheme, it seems that for H-scheme the 
increase of gradient will always enhance synchronizability. However, from the view point of 
gradient network, the increase of gradient in H-scheme may induce the breaking problem which 
will suppress synchronization. Meanwhile, a 'younger' node receives gradients equally from all 
its 'older' neighbors despite their detail difference, this may confuse the target synchronous state 
to which the 'younger' node should follow |15|1. Therefore the gradient functions are not fully 
explored in H-scheme. 

As a comparison, we also plot in Fig. 3(a) the result of the new scheme described by Eq. [2] 
For (3 < 0, the gradient flows from smaller degree node to larger degree node and the opposite 
happens when (3 > 0. The weight of the gradient is adjusted by the absolute value of (3. It can 
be found that, as (3 increases, the eigenratio R monotonically decreases from large values to small 
values. As we will show later, the smallest value that R can reach is only determined by the largest 
eigenvalue A at, which is almost constant for different coupling schemes. (In the extreme situation 
of (3 — > oo, the coupling matrix takes the form of the reduced gradient network. There will be 
only two eigenvalues, A^ and A 2 , while A 2 equals 1.) When (3 = 0, we recover to the situations of 
Ph = Pc — and (3m = 1 used in the previous schemes, respectively. Significantly, the maximum 
synchronizability at (3 H = —I can be achieved at around (3 ~ 5, while R can be further decreased 
as (3 increases in the new scheme. In this sense, we say that the new scheme is more efficient in 
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FIG. 3: (Color online). For the same SFNs as in Fig. 2. (a) The variations of eigenratio R as functions 
of the gradient parameters, Pm > /3c> Ph, and /?, for different coupling schemes, (b) The eigenratio R as 
a function of degree heterogeneity 7 for different coupling schemes. The three dashed lines represent the 
eigenratio of RN under the situation of, from top to bottom, without gradient, with M-scheme, and with the 
new scheme of Eq. |2j respectively, (c) The variation of the A2 as a function of heterogeneity for different 
schemes. Each data is averaged over 50 realizations. 

employing gradient than the other schemes. 



Noticing the fact that increasing degree heterogeneity could suppress synchronizability 1150, 
we go on to compare the synchronizabilities of the different schemes as a function of heterogene- 
ity. The variation of R as a function of 7 is plotted in Fig. 2(b) together with four reference 
configurations: SFN and RN without gradient, RN of M-scheme, and RN of the new coupling 
scheme. To make the comparison fair, we adopt (3m = 1 and /3c = 1, where the maximum syn- 
chronizabilities are reached for the corresponding schemes. To make a fair comparison between 
the new scheme and the H-scheme, we adopt (3h = —0.5 and j3 = 1.5, since under this setting 
the total gradient is equal for these two schemes. It can be found that the new scheme has a clear 
advantage over all the other schemes. It is also found that, under the new scheme, networks of 
higher heterogeneity shows a much clear advantage over the homogeneous ones, while for the 
other schemes the advantage is relatively weak. Based on this observation, we say that the new 
scheme not only efficiently enhances the synchronizability of SFNs, as compared to their original 
configurations, but also makes SFNs prominently superior to RN. This finding provides a more 



stronger explanation to the paradox of network synchronization ||18fl. Another quantity used to 
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characterize synchronizability is A2, the second smallest eigenvalue. Since a larger value of A2 
usually represents a smaller coupling cost in reaching the global synchronization, i.e. e > 01/A2. 
The variation of A 2 as a function of heterogeneity is plotted in Fig. 3(c), it is found that the new 
scheme has a larger value of A 2 in comparison with the other schemes. 

VI. UNDERSTANDING THE MULTIPLE EFFECTS OF GRADIENT 

To explore the underlying mechanisms behind the new scheme, and also to manifest the basic 
principles we proposed for network construction in Sec. Ill, we go on to characterize the gradient 
network by other two quantities: the distribution of gradient weight and the distribution of eigen- 
values. The gradient weight, as described by Eq. [3l is some value between AG m i n ~ 0, where the 
connected nodes have the similar scalar, and AG max ~ 1, where the link connect the largest de- 
gree and the smallest nodes. In Fig. 4(a) we plot the weight distributions of the gradient networks 
for all the coupling schemes. A clear difference is that the weight distribution of the new scheme 
has a long tail. According to Eq. [2l a larger AGjj represents a larger degree difference between 
the connected nodes. This is in accordance with the second principle in network construction, i.e. 
the gradient weight should be proportional to the the scalar potential. As a comparison, in other 
schemes the node receives gradients from it neighbors in a relatively mean fashion. For example, 
In H-scheme, the 'younger' node receives equal gradient from all the 'older' neighbors, while 
disregards the degree difference among them. The advantage of the new scheme is also reflected 
in the eigenspectrum. In Fig. 4(b) we plot the eigenvalue distributions for different coupling 
schemes. It can be found that, while the largest eigenvalue A^v is similar for all the schemes, the 
new scheme is distinct with a larger value of A2 and an absolutely higher probability around A = 1. 
This property makes the eigenvalues to be restricted within a tight region around A = 1, and make 
the value of eigenratio R be quickly decreased as j3 increases. The extreme situation will be all 
the eigenvalues, except A^ and Ai, equal 1, where the maximum synchronizability is achieved and 
R = Ajy ■ 

From Figs. 4(a) and (b), it seems that increasing gradient will monotonically increases the 
synchronizability. However, as shown in Fig. 2(b), too large gradients may suppress synchroniz- 
ability, since gradient could induce the risk of network breaking. Now we show this phenomenon 
via eigenvalue analysis. In Fig. 4(c) we plot eigenratio R versus gradient (3 for networks of dif- 
ferent heterogeneities. It is found that, as the heterogeneity decreases (i.e. increase the value of 
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FIG. 4: (Color online). For the same SFN as in Fig. 2. Comparing (a) the distributions of gradient weight 
AG and (b) distributions of eigenvalues among the different coupling schemes, (c) For the new scheme, the 
variation of R as a function of j3 for networks of different heterogeneities. Optimal gradient happens around 
(3 Q 0.7 when 7 = 10. (d) The distribution of R as a function of the network realizations for different (3 at 
7 = 10. 

7), in the region of f3, the gradient gradually changes its role from enhancing synchronizability 
to suppressing synchronizability. That is, for networks of lower heterogeneity and smaller mean 
degree, there exist an optimal gradient at (3 Q . When (3 < (3 Q , increasing gradient will enhance 
synchronizability, but when (3 < (3 Q , the opposite happens. The position where this transition 
appears depends on the values of 7 and < k >, for densely connected SFN the value (3 Q will be 
significantly delayed. The breaking effect can be further understood from Fig. 4(d), where we 
plot the eigenratio R for a number of network realizations for fixed 7 and < k >. It is found that, 
for smaller gradient (3 < (3 , R keeps on small values, representing that the network is still well 
connected. In this region, increase (3 will enhance the synchronizability; but for larger gradient 
(3 > (3 , R intermittently jumps to very large values, reflecting that the network is broken in some 
realizations. Therefore in this region increase (3 will suppress the synchronizability. 
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VII. NUMERICAL SIMULATIONS 



We now provide the results of direct simulations. It was shown that, although the MSF 
method was proposed for complete synchronization of coupled identical systems, the eigen- 
ratio R could still provide a qualitative description for the collective behaviors, e.g. phase 



synchronization, of coupled nonidentical systems 11181 1201 . 24]. We employ SFN of noniden- 
tical chaotic Rossler oscillators as the model. The dynamics of a singular oscillator reads 
Fj(x.j) = [— LUii/i — Zi,LUiXi + 0.15^, Zi(xi — 8.5) + 0.4], with uji the natural frequency of os- 
cillator i, which is randomly assigned in range [0.9, 1.1]. The coupling form is H(x) = x. The 
degree of synchronization in this model can be characterized by monitoring the amplitude A of the 
mean field X = J2f=i X i/N II la. 12411. For small coupling strength, X oscillates irregularly and A 
is approximately zero, reflecting a smaller degree of synchronization; while X oscillates regularly 
and A increases sharply as coupling strength exceeds a critical value, reflecting a larger degree of 
synchronization. In Fig. 5(a) we plot the behavior of A as a function of the coupling strength e 
for all the coupling schemes, it is found that the new scheme has a clear advantage over the other 
schemes even for smaller [3, especially in the small the region of small couplings. To demonstrate 
the positive effect that gradient plays in the new scheme, we plot in Fig. 5(b) the behavior of A 
as a function of the gradient degree (3. Again, as predicted by the eigenvalue analysis, A increases 
monotonically as (3 increases. 

To show the breaking effect, we have carried the same simulations but for a homogeneous 
sparse network, i.e. < k >= 4 and 7 — > 00. As shown by the inset in Fig. 5(b), there is indeed a 
maximum around /3 « 1 . Before this value, the increase of gradient will monotonically enhance 
the synchronizability, while after this value, increase gradient will suppress synchronizability. As 
we have analyzed, too large gradient induce the breaking effect and could suppress synchroniza- 
tion. However, in the region of (3 > (3 Q , nodes belong to the same tree are still synchronized and the 
network breaks into synchronized clusters, therefore it is expected that the decrease of A after (3 
will be slow. Since this time although the network is not globally synchronized, strong coherence 
still exists within the clusters. The simulation results of Fig. 5(b) also testified our analysis that the 
network breaking effect is closely related to the mean degree < k > and the degree heterogeneity 
7, i.e. Eq. [TTJ Since in Fig. 5(b), where the substrate is densely connected SFN, we can not find 
the transition phenomenon, while for the sparsely connected RN network for the inset plot, we 
find the transition. 
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FIG. 5: (Color online). For SFNs of N = 2 W nodes and mean degree < k >= 10, directed simulation of 
coupled nonidentical Rossler oscillators, (a) The mean field amplitudes as a function of coupling strength for 
different coupling schemes. The parameters are (3m = 1 for M-scheme, j3c = 1 for C-scheme, f3jj = —0.5 
for H-scheme, (3 = 1.5 and 5 for the new scheme. The total gradient in H-scheme when [3h = —0.5 and 
—1 equal that of the new scheme when j3 = 1.5 and 5, respectively, (b) For the new scheme, fixing e = 0.1, 
the variation of mean field amplitude as a function of gradient. Each data is averaged over 10 network 
realizations. Inset is plotted for sparsely linked homogeneous network where each data is averaged over 
1000 network realizations. 

VIII. DISCUSSION AND CONCLUSION 

Now we are able to answer the paradox described at the beginning of this paper: under what 
conditions that heterogeneous networks will be superior to homogeneous ones in synchronizabil- 
ity. The key point is gradient. By modifying the strength of the directed couplings, we can adjust 
the gradient direction and weight. To make the SFN outstand, the proper way to set the direction 
is making the gradient flow from the larger degree node and point to the smaller degree node; and 
a convenient method to set the gradient weight can be making it be proportional to the degree 
difference. If we set the direction and weight in the opposite ways, SFN will be much difficult 
to synchronize than RN. This finding thus indicates that, with proper gradient, both two kinds of 
heterogeneities, the heterogeneous degree distribution and heterogeneous weight distribution, can 
be used to improve network synchronizability instead of suppression. 

The advantage that SFN superior to RN becomes even clear when considering the breaking 
effect. According to our finding, in achieving a stronger synchronizability, heterogeneous network 
can bear larger gradient than homogeneous network. The optimal gradient /3 G , where the maximum 
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synchronizability is achieved, is closely related to the heterogeneity exponent 7 and the mean 
degree < k >. The finding that sparse network can not bear too much gradient may have important 
implications to the function of many natural networks which have sparse links while gradient 
exists, e.g., the metabolic network where < k >m 7.4 and the protein network where < k 2.39 
Oi |4fl. Remarkably, because most technological (e.g. the Internet and WWW) and biological 



networks (e.g. the protein and neural networks) have the property of disassortativity [27], i.e. 
larger degree nodes tend to repulse from each other, the breaking effect will be more relevant in 
these systems. 

Another advantage enjoyed by this new scheme is that, in constructing the coupling matrix, it 
only employs the local network information. More accurately, the degree information of the node 
itself and its neighbors. While schemes based on global network information, e.g. the betweenness 



centrality employed in C-scheme and the oriented tree employed in Ref. 112 111 , are possible for 
small size networks, the constructions based on local information, e.g. the node degree employed 
in M-scheme and H-scheme, could be more efficient and practical in practical. We note that in the 
new scheme the setting of the gradient is determined by the information of the neighbors, instead 
of the node itself. This is one of the key points making the new scheme prominent. We also note 
that the proposed new scheme only provide one choice in employing the gradient, other methods 
which may involve complex construction rules and global network information, i.e. to design 
the gradient case by case depending on the specific topology structure, may further promote the 
synchronizability. But these methods may not as convenient as this new scheme. 

In conclusion, we have employed gradient network to the problem of network synchroniza- 
tion. Under this framework, previous studies on asymmetric networks can be well unified and the 
principles for synchronizability enhancement become clear and systematic. Our studies not only 
indicates that, comparing to homogeneous networks, scale-free networks are the natural choice for 
synchronization, but also predict that, for practical networks of low heterogeneity and small mean 
degree, there should exist an optimal gradient (3 Q where the synchronizability is maximized. We 
expect this prediction to be verified by empirical findings in future. 
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